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(54) Copyright information embedding apparatus 

(57) A copyright information embedding system is 
provided which is designed to embed information for 
copyright protection into digital audio signals without 
deterioration of analog audio signals reproduced. The 
copyright information embedding system includes an 
A/D converter (31). a modulator (1 16), a level detector 
(200). and a copyright data embedding circuit (40). The 
A/D converter (31) converts an analog audio signal into 
a digital signal. The modulator (116) modulates a copy- 
right data signal for the digital signal using spectrum 
spread. The level detector (200) detects a variation in 
level of the digital signal. The copyright data embedding 
circuit (40) divides the copyright data signal into several 
codes and embeds them into the digital signal each time 
the variation in level of the digital signal shows a prese- 
lected variation such as a rapid rise or drop. 
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Description 

BACKGROUND OF THE INVENTION 

5 1 Technical Field of the Invention 

The present invention relates generally to a copyright information embedding apparatus designed to embedding 
information for managing copyright in a storage medium when recording analog signals such as audio signals in digital 
form, and a record carrier recording thereon that information. 

10 

2 Background of Related Art 

Optically readable discs such as "Compact Discs" have come into wider use as audio record earners than conven- 
tional magnetic tapes. An EFM recording format using 8-bit fixed length data symbols and a data format including a sub- 
15 code, audio data, and a CRC are established as logical formats for CDs. CD players having a variety of application 
functions are being developed. 

CDs are also used as CD-ROMs by discriminating control bits (four bits) in a subcode of a Q channel or detecting 
the absence of a TOC and have wide applicability to the field of electronic publication for mass storage and high-speed 
access. The CD-ROMs, however, have the drawback in that audio signals are compressed by ADPCM, which makes it 
20 impossible to reproduce the audio signals at original quality levels. A recording system designed to achieve the high 
f idelity is sought. In other words, development of optical discs capable of recording audio signals within a band of twice 
that of a conventional CD is expected. 

Such high-quality hi-fi signals do not deteriorate in a duplication process as long as they are copied in digital form, 
which is quite convenient for users, but undesirable from the viewpoint of copyright protection. For avoiding such a prob- 
25 lem, a system designed to limit the number of copies of digital information (U.S.R No. 5,428.598). a system having no 
digital signal output terminals, a system designed to remove part of a band of an analog output signal, a system embed- 
ding copyright data into digital data (U.S. P. No 5.319,735), and a system identifying an user who made a copy by 
detecting an identification signal formed by slightly changing original data, have been proposed. 

The system embedding copyright data into digital data, however, has the drawback in that D/A conversion of the 
so digital data into analog audio signals in a reproduction operation would cause reproduced sound quality to be deterio- 
rated or changed uncomfort a bly. 

SUMMARY OF THE INVENTION 

35 It is therefore a principal object of the present invention to avoid the disadvantages of the prior art 

It is another object of the present invention to provide a copyright information embedding system designed to 
embed information for copyright protection into digital signals without deterioration of analog signals reproduced. 

According to one aspect of the present invention, there is provided a copyright information embedding apparatus 
which comprises: (a) an A/D conversion means for converting an analog audio signal into a digital signal; (b) a modu- 
40 lation means for modulating a copyright data signal for the digital signal using spectrum spread; (c) a level detection 
means for detecting a variation in level of the digital signal; and (d) a copyright data embedding circuit embedding the 
copyright data signal into the cf g'rtal signal when the variation in level of the digital signal detected by the level detection 
means shows a preselected variation. 

In the preferred mode of the invention, the copyright data embedding circuit embeds the copyright data into the dig- 
45 rial signal during a time when a level of the digital signal is decreased. 

The copyright data embedding circuit may alternatively embed the copyright data into the digital signal during a 
time when a level of the digital signal is increased. 

The copyright data embedding circuit divides the copyright data into several codes and embeds them into the digital 
signal intermittently. 

so The copyright data embedding circuit may record the copyright data into the digital signal in random cycles. 

The copyright data embedding circuit may also embed the copyright data into the digital signal when an average 
level of the digital signal sampled over a preselected period of time is greater than a given value. 

According to another aspect of the invention, there is provided a record carrier which comprises: (a) a digital signal 
into which an analog audio signal is converted; and (b) a copyright data signal carrying copyright information about the 
55 digital signal, modulated with spectrum spread, the copyright data signal being embedded into the digital signal each 
time a variation in level of the digital signal shows a preselected variation. 

In the preferred mode of the invention, the copyright data signal is embedded into the digital signal during a time 
when a level of the digital signal is decreased. 
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The copyright dSsignal may alternatively be embedded into the digital signal during a time when a level of the 
digital signal is increased. 

The copyright data signal may be embedded into the digital signal intermittently. 

The copyright data signal may be embedded into the digital signal in random cycles. 
6 The copyright data signal may also be embedded into the digital signal when an average level of the digital signal 
sampled over a preselected period of time is greater than a given value. 

A second copyright data signal identical with the copyright data signal is recorded on a subcode of the digital signal. 

A third copyright data signal identical with the copyright data signal is recorded on a copyright information manage- 
ment area defined on the record carrier. 
10 According to the third aspect of the invention, there is provided a copyright information embedding apparatus which 
comprises: (a) an A/D conversion means for converting an analog audio signal into a digital signal; (b) a modulation 
means for modulating a copyright data signal carrying copyright information about the digital signal using spectrum 
spread; (c) a frequency detection means for detecting a frequency of the digital signal; and (d) a copyright data embed- 
ding circuit embedding the copyright data signal into the digital signal at a preselected power level different from that of 
is the digital signal. 

In the preferred mode of the invention, the copyright data embedding circuit detects a variation in level of the digital 
signal and changes the power level according to the variation in level detected. 

The copyright data embedding circuit may embed the copyright data signal into the digital signal at the preselected 
power level regardless of the variation in level of the digital signal when an average level of the digital signal sampled 
20 over a preselected period of time is greater than a given valua 

According to the fourth aspect of the invention, there is provided a record carrier which comprises: (a) a digital sig- 
nal into which an analog audio signal is converted ; and (b) a copyright data signal carrying copyright information about 
the digital signal, modulated with spectrum spread, the copyright data signal being embedded into the digital signal at 
a preselected power level different from that of the digital signal. 
25 In the preferred mode of the invention, the preselected power level is changed according to a variation in level of 
the digital signal. 

The copyright data signal may be embedded into the digital signal at the preselected power level regardless of the 
variation in level of the digital signal when an average level of the digital signal sampled over a preselected period of 
time is greater than a given value. 
30 A second copyright data signal identical with the copyright data signal may be recorded on a subcode of the digital 
signal. 

A third copyright data signal identical with the copyright data signal may be recorded on a copyright information 
management area def ined on the record carrier. 

According to the fifth aspect of the present invention, there is provided a copyright information embedding method 
35 comprising the steps of: (a) A/D-converting an analog audio signal into a digital signal; (b) modulating a copyright data 
signal for the digital signal using spectrum spread; (c) detecting a variation in level of the cfigital signal; and (d) embed- 
ding the copyright data signal into the digital signal when the variation in level of the digital signal detected by the level 
detection means shows a preselected variation. 

According to the sixth aspect of the present invention, there is provided a copyright information embedding method 
40 comprising the steps of: (a) A/D-converting an analog audio signal into a digital signal; (b) modulating a copyright data 
signal carrying copyright information about the digital signal using spectrum spread; (c) detecting a frequency of the 
digital signal; and (d) embedding the copyright data signal into the digital signal at a preselected power level different 
from that of the digital signal. 

According to the seventh aspect of the present invention, there is provided a copyright information embedding 
45 apparatus which comprises: (a) an A/D conversion means for converting an analog audio signal into a digital signal; (b) 
a modulation means for modulating a copyright data signal for the digital signal using spectrum spread; (c) a level detec- 
tion means for detecting a level of the digital signal; and (d) a copyright data embedding circuit embedding the copyright 
data signal into the digital signal when the level of the digital signal detected by the level detection means lies within a 
preselected ranga 

so 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be understood more fully from the detailed description given hereinbelow and from the 
accompanying drawings of the preferred embodiment of the invention, which, however, should not be taken to Omit the 
55 invention to the specific embodiment but are for explanation and understanding only. 
In the drawings: 

Fig. 1 is a block diagram which shows a copyright information embedding apparatus according to the present tnven- 



3 



Page: 3 



> 




EP0 822 550A1 




tion; 



10 



15 



20 



25 



30 



35 



40 



50 



Rg. 2 is a block diagram which shows a circuit structure of a signal processing circuit of the copyright information 
embedding apparatus in Fig. 1 ; 

Fig. 3 is a graph which shows a data stream sampled by an A/D converter; 

Fig. 4 shows a user data code provided by an allocation circuit of the signal processing circuit in Fig. 2; 
Fig. 5 is a flowchart of a program of a copyright data embedding operation performed by a control circuit of the sig- 
nal processing circuit shown in Fig. 2 according to the first embocfiment of the invention; 
Fig. 6(a) shows a waveform of an original input signal; 

Fig. 6(b) shows the relation among a peak level, an average level of a signal into which the original input signal in 
Fig. 6(a) is converted in digital form, and the time during which a copyright data signal is embedded; 
Fig. 7 is a flowchart of a program of a copyright data embedding operation which is a modification of the one shown 
in Fig. 5; 

Fig. 8 is a block cfiagram which shows a decoder of the invention; 

Fig. 9 is a circuit diagram which shows a signal processing circuit of the decoder in Fig. 8; 

Fig. 10 is a graph which shows a data stream interpolated by an interpolator in Fig. 9; 

Fig. 1 1 is a block diagram which shows a signal processing circuit which is a modification of the one shown in Fig. 2; 
Fig. 12 is a circuit diagram which shows a signal processing circuit which is a modification of the one in Fig. 9; 
Fig. 13 is a flowchart of a program of a copyright data embedding operation according to the second embodiment 
of the invention; 

Fig. 14(a) shows a waveform of an original input signal; 

Fig. 14(b) shows the relation among a peak level, an average level of a signal into which the original input signal in 
Fig. 14(a) is converted in digital form, and the time during which a copyright data signal is embedded; 
Fig. 15 is a flowchart of a program of a copyright data embedding operation according to the third embodiment of 
the invention; 

Fig. 1 6 is a flowchart of a program of a copyright data embedding operation according to the fourth embodiment of 
the invention; 

Fig. 1 7(a) shows a waveform of an original input signal; 

Fig. 1 7(b) shows the relation among a peak level, an average level of a signal into which the original input signal in 
Fig. 1 7(a) is converted in digital form, and the time during which a copyright data signal is embedded; 
Fig. 18 is a flowchart of a program of a copyright data embedding operation according to the fifth embodiment of 
the invention; 

Fig. 19 is a flowchart of a program of a copyright data embedding operation according to the sixth embodiment of 
the invention; 

Rg. 20(a) shows a waveform of an original input signal; 

Rg. 20(b) shows the relation among a peak level, an average level of a signal into which the original input signal in 

Rg. 20(b) is converted in digital form, and the time during which a copyright data signal is embedded; 

Rg. 21 is a flowchart of a program of a copyright data embedding operation which is a modification of the sixth 

embodiment; 

Rg. 22 is a flowchart of a program of a copyright data embedding operation according to the seventh embodiment 
of the invention; 

Rg. 23 is a flowchart of a program of a copyright data embedding operation which is a modification of the seventh 
embodiment in Rg. 22; 

Rg. 24(a) shows a waveform of an original input signal; 

Rg. 24(b) shows the relation among a peak level, an average level of a signal into which the original input signal in 
Rg. 24(a) is converted in digital form, and the time during which a copyright data signal is embedded; 
Rg. 25 is a block diagram which shows a signal processing circuit according to the eighth embodiment of the inven- 
tion; 

Rg. 26 is a graph which shows an audtoility masking effect; 

Rg. 27 is a graph which shows the relation between a masking sensitivity and the frequency; 

Rg. 28 is a graph which shows a CMR (Code to Music Ratio) between an original signal and a copyright data signal 

in terms of the frequency; 

Rg. 29 is a flowchart of a program of a copyright data embedding operation according to the ninth embodiment; 
Rg. 30(a) shows a waveform of an original input signal; 

Rg. 30(b) shows the relation between a peak level and an average level of a signal into which the original input sig- 
nal in Rg. 30(a) is converted in digital form; 
Rg. 30(c) shows a variation in level of a copyright data signal; 

Rg. 31 is a flowchart of a program of a copyright data embedding operation which is a modification of the ninth 
embodiment shown in Rg. 29; 
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Fig. 32 is a drWreagram which shows a modification of a signal processing circuit of the eighth embodiment 
shown in Fig. 25; 

Rg. 33 illustrates a packet structure of a DVD (Digital Video Disc); 

Rg. 34 shows another CMR between an original signal and a copyright data same as Fig. 28; 
s Fig. 35(a) shows a waveform of an original input signal; and 

Fig. 35(b) shows the relation between a peak level and an average level of a signal in Fig. 31. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

10 Referring now to the drawings, particularly to Rg. 1 , there is shown a copyright information embedding apparatus ; 
(encoder) 300 according to the present invention. 

The copyright information embedding apparatus 300 includes generally an A/D converter 31, a signal processing 
circuit 32, a memory 33, a DVD encoding circuit 34, and a modulation circuit 35. When an analog signal such as an 
audio signal is inputted to an input terminal IN, it is sampled by the A/D converter 31 at a high sampling frequency (i.e., 

is sampling periods At in Rg. 3). for example, 192kHz enough to prohibit digital copying without authorization and con- 
verted into, for example, a data stream of 24-bit high-resolution PCM signals, as shown below, along a curve a in Rg. 3. 

Xb1.x1,xa1,x2,xb2, x3,xa2, • • • xbi, x2M, xai, x2i * • • 

zo The above data stream is encoded by the signal processing circuit 32 and the memory 33 and packed by the DVD 
encoding circuit 34, which is, in turn, outputted directly from an output terminal OUT1 or modulated by the modulation 
circuit 35 according to a type of record carrier and outputted from an output terminal 02. Rom an output terminal 03, 
copyright data is outputted as needed. 

Rg. 2 shows a circuit structure of the signal processing circuit 32. 

25 An output signal from the A/D converter 31 is inputted to an adder circuit 121 . The adder circuit 121 adds copyright 
data, as will be discussed later in detail, to the input signal and outputs it to a low-pass filter (LPF) 36. The LPF 36 
includes, for example, a FIR filter allowing signals having frequencies within a 1/2 band to pass therethrough and 
selects a data stream ofxcl. xc2. ♦,xc3, xci, •>.•, • • • along a curve p. as shown in Rg. 3. from 
the data stream of xbi, x2i-l , xai, x2i along the curve a. 

so A decimating circuit 37 removes data samples * from the data stream outputted from the LPF 36 to produce a data 
stream of xd. xc2, xc3, • • •, xci, • * • . Similarly a decimating circuit 38 removes data samples xi from the data 
stream outputted from the LPF 36 to produce a data stream of xb1, xa1. xb2, xa2. • • •, xbi, xai, • • •. 

A difference calculating circuit 39 which includes an adder determines differences A1i (=»b-xcO and 
A2i (= xai - xci) based on the data streams outputted from the decimating circuits 37 and 38. The difference data A1 i 

35 and A2i each consist of 24 or less bits. The number of bits may be either fixed or changed. 

An allocation circuit 40 packs the data stream xci from the decimating circuit 37, the difference data A1 i and A2i, 
and copyright data together to produce user data codes (one is shown in Rg. 4) which are, in turn, recorded on a DVD 
(digital video disc) or outputted to a transmission path, for example. When recorded in the DVD, each user data code 
consists of 2034 bytes as shown in Rg. 33, the niimber of pieces of each of tte da 

40 are 225, and each data consists of 3 bytes, and a subheader consists of a 9 bytes. The data stream of xci corresponds 
to a data stream sampled at a sampling frequency of one-fourth that in the A/D converter. 
Embedding of copyright data will be discussed below. 

A copyright data generator 100 produces copyright data on an audio signal inputted to the input terminal IN which 
comprises, for example, a copyright serial number ISRC (International Standard Recording Code, 16 bytes or less) for 
45 copyright management a cutting player identification code (4 types or less) which is used as a SID (Source Identifica- 
tion) code, a recording date (3 bytes), a number of a recording (3 bytes), the number of copies (4 bytes), and the 
number of times allowing a copy to be made (3 bytes) and supplies it both to an FM modulator 114 and the allocation 
circuit 40. 

The allocation circuit 40 divides the copyright data into several pieces and adds them to some of the subheaders 
so of the user data codes, as shown in Rg. 4. In case of a DVD. the copyright data is also recorded in a copyright manage- 
ment information (CMI) area formed on an inner peripheral section of the DVD which corresponds to a TOC area pro- 
vided on a CDR disc for example. The CMI area is defined within a partial RAM a a PCA (post cutting area). BCA 
(burst cutting area). 

The FM modulator 1 14 modulates the copyright data at a frequency of, for example, 5kHz outputted from an oscfl- 
55 lator 1 1 5 and supplies it to a spread modulator 1 1 6. The spread modulator 1 1 6 spreads the frequency spectrum of the 
copyright data modulated by the FM modulator 1 1 4 using a spread code generated by a spread code generator 1 1 7 so 
that it cannot be perceived acoustically even if D/A converted. A level control circuit 1 18 controls the level of an output 
from the spread modulator 1 1 6 according to the level of the data stream (xbi, xa1) outputted from the decimating circuit 
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38. For example, when the frequency of an original audio signal is 2kHz, the level control circu^n8 decreases the level 
of the output from the spread modulator 116 by -25dB. When it is 10kHz, the level of the output from the spread mod- 
ulator 1 16 is decreased by -19dB. Specifically, the level control circuit 118 decreases the level of the output from the 
spread modulator 1 1 6 below a OMR (Code to Music Ratio) in a psychoacoustic model so that the copyright data cannot 
5 be perceived acoustically by a listener and provides a level-controlled signal to the adder 121 through a switch 201 to 
embed it into the output signal from the A/D converter 31 . 

The control circuit 200 provides control signals a. & and c_ to the copyright data generator 100. the spread code 
generator 117, and the switch 201 in a copyright data embedding operation. 

Fig. 5 shows a program or sequence of logical steps of the copyright data embedding operation performed by the 
10 control circuit 200. 

After entering the program, the routine proceeds to step 10 wherein an output signal from the A/D converter 31 is 
filtered using a weighting filter to decrease the level thereof in a high and middle (high-mid) frequency band for modify- 
ing the audibility. The routine proceeds to step 20 wherein an average level Lav (a corrected value) and a peak level Lp 
of the filtered signal outputted from the A/D converter 31 are determined. For example, the average level Lav is deter- 
is mined by sampling the signal outputted from the A/D converter 31 over 300 msec, so that it may, as shown in Fig. 6(b), 
coincide with the peak level Lp when a given number of consecutive constant amplitudes of an original signal, as shown 
in Rg. 6(a). appear. 

The routine proceeds to step 30 wherein it is determined whether the peak level Lp is greater than the average level 
Lav or not. If a YES answer is obtained (Lp > Lav), then the routine proceeds to step 40 wherein the control circuit 200 
20 provides the control signals & fe, and £ of an ON-levei to the copyright data generator 100, the spread code generator 
1 1 7, and the switch 201 to start the copyright data embedding operation. Specifically, the copyright data generator 1 00 
produces the copyright data to the allocation circuit 40 and the FM modulator 1 14. The spread modulator 116 modu- 
lates the output from the FM modulator 1 14 in response to the control signal b inputted to the spread code generator 
1 17. The switch 201 is turned on to embed the copyright data level-controlled by the level control circuit 1 18 into the 
25 output from the A/D converter 31 through the adder 121. 

Art er natively, if a NO answer is obtained in step 30, then the routine proceeds to step 50 wherein the control circuit 

200 provides the control signals a, & and £ of an OFF-level to the copyright data generator 1 00, the spread code gen- 
erator 1 17, and the switch 201 to prohibit the copyright data embedding operation. Specifically, the copyright data gen- 
erator 100 holds the copyright data from being outputted to the allocation circuit 40 and the FM modulator 114. The 

so spread modulator 1 16 is deactivated. The switch 201 is turned off to block the communication between the adder 121 
and the level control circuit 1 18. rf the control signals a, and £ of the OFF-level are provided before one of data codes 
constituting the copyright data is recorded completely, the copyright data embedding operation is deactivated after com- 
pletion of recording of that data coda 

Rg. 7 shows a program of the copyright data embedding operation performed by the control circuit 200 which is a 

as modification of the one shown in Fig. 5. The same reference numbers as employed in Fig. 5 refer to the same steps, 
and explanation thereof in detail will be omitted here. 

After step 20, the routine proceeds to step 130 wherein it is determined whether the average level Lav is greater 
than a value of a full peak minus 1 9d B or not The full peak is an upper limit at which a signal is allowed to be recorded. 
If a YES answer is obtained, then the routine proceeds to step 40 wherein the control circuit 200 provides the control 

40 signals a b. and c of the ON-level to the copyright data generator 100, the spread code generator 1 17, and the switch 

201 to start the copyright data embedding operation. Alternatively, if a NO answer is obtained in step 1 30, then the rou- 
tine proceeds to step 30 wherein it is determined whether the peak level Lp is greater than the average level Lav or not. 
If a NO answer is obtained, then the routine proceeds to step 50 wherein the control circuit 200 provides the control 
signals a, and c of an OFF-level to the copyright data generator 100, the spread code generator 1 17. and the switch 

45 201 to prohibit the copyright data embedding operation. 

Rg. 8 shows a circuit structure of a decoder 500 according to the present invention. 

The decoder 500 includes a demodulator 41 , a DVD decoding circuit 42, a signal processing circuit 43, a memory 
44, a decoder/comparator 50, a copyright data updating circuit 30, a low-pass filter 53, and a D/A converter 56. 

When a signal coded by the copyright information embedding apparatus 300 is inputted to the demodulator 41 , the 
so demodulator 41 demodulates the input signal according to a modulation format of the modulating circuit 35 of the cop- 
yright information embedding apparatus 300 and outputs it to the DVD decoding circuit 42. The DVD decoding circuit 
42 decodes the input signal and provides decoded signals each consisting of the data stream of xri into which the cop- 
yright data is embedded and the difference data A1 i and A2i to the signal processing circuit 43 and the copyright data 
updating circuit 30. The DVD decoding circuit 42 also provides the copyright data which is unpacked from the subhead- 
55 era of the user data codes or reproduced from the CM I area of the DVD to the decoder/comparator 50. 

The signal processing circuit 43 includes, as shown in Rg. 9, an adder 46 and an interpolator 47. The adder 46 
receives the decoded signal outputted from the DVD decoding circuit 42 and performs addition operations, as shown 
below, to restore the data stream of xbi and xai each consisting of 24 bits similar to the original data stream. 
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A1i + xci = xbi 



A2i+xci = xai 

6 The interpolator 47 finds or interpolates data xi, as shown in Fig. 10. intermediate between the data xai and xbi. 
The interpolation of the data xi may be achieved by setting the data xi to zero (0) using the so-called up sampling tech- 
nique and passing them through a low-pass filter. The data xi may alternatively be found with curve approximation or 
predictive approximation. In case of the predicative approximation, a measure of approximation may be improved by 
adding approximated subdata to the difference data A1 i and A2i. 

10 The data xai, xbi, and xi are arranged as follows: 

xbi,x1,xa1, x2,xb2, x3,xa2, • • • xbi, x2i-1.xa1. x2i, • • • 

The above data stream is supplied from the signal processing circuit 43 to the D/A converter 55, the LPF 56. and 
15 a digital output terminal 90. 

The D/A converter 45 converts the data stream of xbi, x2M , xai, and x2i, which are A/D converted by the encoder 
(i.e.. the copyright information embedding apparatus 300) with 24 quantization bits and into which the copyright data is 
embedded, into an analog signal at a sampling frequency of 192kHz and outputs it through an analog output terminal 
55. The LPF 56 passes the input signal from the signal processing circuit 43 within a frequency band (e.g., 48kHz) of 
20 one-fourth that of the input signal and outputs it through an output terminal 53. The data stream of xbi, x2M , xai, and 
x2i outputted from the 6ignai processing circuit 43 is also outputted directly from a digital output terminal 90. 

Figs. 11 and 12 show modifications of the encoder (i.e., the copyright information embedding apparatus 300) 
shown in Figs. 1 and 2 and the decoder shown in Figs. 8 and 9, respectively. The same reference numbers as employed 
in the above embodiments refer to the same parts, and explanation thereof in detail will be omitted here. 
25 The encoder 310, as can be seen from the drawing, does not have the decimating circuit 38 which removes the 
data xi from the input signal. Specifically, the difference calculating circuit 39 determines difference data A1i, A2i, and 
A3i, as shown below. 

xbi-xd= A1i 

30 

xai - xci o A2i 
xi - xci = A3i 

35 The allocation circuit 40 packs the data stream of xci, A1i, A2i, and A3i and the copyright data together and outputs 
it The copyright data is, similar to the first embodiment, embedded into the data stream of xci, A1i, A2i, and A3i inter- 
mittently. 

The decoder, as clearly shown in Fig. 1 2, does not have the interpolator 47 in Fig. 9 because the encoder 310 does 
not remove or decimate the data xi. Specifically, the adder 46 performs addition operations below to restore the original 
40 data stream of xbi, x2i-1 , xai, and x2i. The other arrangements are identical with those shown in Fig. 8. and explanation 
thereof will be omitted here. 

xd + A1i=xbi 

45 xci + A2i s xai 

xci + A3ioxi 

Fig. 13 show a program of the copyright data embedding operation according to the second embodiment of the 
so invention. 

After entering the program, the routine proceeds to step 210 wherein the control circuit 200 sets a rising time con- 
stant and a falling time constant to, for example. 1 msec, and 150 msec, respectively, to determine a peal level Lp of 
an output from the A/D converter 31 . The routine proceeds to step 220 wherein an average level Lav is determined in 
the same manner as discussed above in Fig. 5. The routine proceeds to step 230 wherein it is determined whether the 
55 peak level Lp is smaller than the average level Lav or not if a NO answer is obtained, then the routine proceeds directly 
to step 50 to prohibit the copyright data embedding operation. Alternatively, if a YES answer is obtained in step 230, 
then the routine proceeds to step 240 wherein it is determined whether or not the YES answer in step 230 has been 
obtained in the first program cyde following a program cycle wherein the NO answer was obtained in step 230. If a YES 
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tine proceeds to step 40 wherein the control circuit 200 prolMrthe control signals fl, 
b, and £ of the ON-level to the copyright data generator 100. the spread code generator 1 1 7, and the switch 201 to start 
the copyright data embedding operation. 

Specifically, the copyright data is embedded into the output from the A/D converter 31 for a period of time during 
5 which one program cycle is completed immediately after the peak level Lp drops, as shown in Rg. 14(b). It is known in 
the art that a signal which is embedded into an audio signal changing in level, as shown in Fig. 14(a). when the audio 
signal drops in level rapidly, is difficult to perceive acoustically. 

Rg. 15 shows a program of the copyright data embedding operation according to the third embodiment which is a 
combination of the ones shown in Figs. 7 and 13. The same step numbers as employed in Figs. 7 and 13 refer to the 
10 same steps. 

In steps 210 and 220, the average level Lav and the peak level Lp of an output signal from the A/D converter 31 are 
determined. 

The routine proceeds to step 130 wherein it is determined whether the average level Lav is greater than a value of 
a full peak minus l9dB or not If a YES answer is obtained, then the routine proceeds to step 40 wherein the control 

75 circuit 200 provides the control signals a. & and £ of the ON-level to the copyright data generator 1 00. the spread code 
generator 117, and the switch 201 to start the copyright data embedding operation. Alternatively, if a NO answer is 
obtained in step 130, then the routine proceeds to step 230 wherein it is determined whether the peak level Lp is smaller 
than the average level Lav or not. H a NO answer is obtained, then the routine proceeds to step 50 wherein the control 
circuit 200 provides the control signals a, & and £ of an OFF-level to the copyright data generator 100, the spread code 

20 generator 1 1 7, and the switch 201 to prohibit the copyright data embedding operation. Alternatively, if a YES answer is 
obtained, then the routine proceeds to step 240 wherein it is determined whether the YES answer in step 230 has been 
obtained in the first program cycle following a program cycle wherein the NO answer was obtained in step 230 or not. 
If a YES answer is obtained, then the routine proceeds to step 40. Alternatively, if a NO answer is obtained, then the 
routine proceeds to step 50 wherein the control circuit 200 provides the control signals & & and £ of an OFF-level to 

25 the copyright data generator 100, the spread code generator 117, and the switch 201 to prohibit the copyright data 
embedding operation. 

Rg. 16 shows a program of the copyright data embedding operation according to the fourth embodiment which is 
a modification of the one shown in Rg. 13. The same step numbers as employed in the second embodiment in Rg. 13 
refer to the same steps, 

so After step 220, the routine proceeds to step 430 wherein it is determined whether the peak level Lp is greater than 
the average level Lav or not If a NO answer is obtained, then the routine proceeds to step 50 wherein the control circuit 
200 provides the control signals & b, and £ of the OFF-level to the copyright data generator 1 00, the spread code gen- 
erator 1 1 7, and the switch 201 to prohibit the next copyright data embedding operation. Alternatively, if a YES answer 
is obtained, then the routine proceeds to step 240 wherein it is determined whether the YES answer in step 430 has 

35 been obtained in the first program cycle following a program cycle wherein the NO answer was obtained in step 430 or 
not ff a YES answer is obtained, then the routine proceeds to step 40 wherein the control circuit 200 provides the con- 
trol signals a b, and £ of the ON-level to the copyright data generator 100, the spread code generator 117, and the 
switch 201 to start the copyright data embedding operation. Alternatively, if a NO answer is obtained in step 240, then 
the routine proceeds to step 50. 

40 Specifically, the copyright data is, as can be seen from Rgs. 1 7(a) and 17(b), embedded into an output signal from 
the A/D converter 31 for each period of time during which the level of the output from the A/D converter 31 rises. It is 
understood that the copyright data will not be perceived acoustically when it is embedded into a sound signal at a time 
when the level of the signal is, as shown in Rg. 1 7(b), changed greatly. 

Rg. 18 shows a program of the copyright data embedding operation according to the f ifth embodiment which is a 

45 combination of the ones shown in Rgs. 7 and 15. The same step numbers as employed in Rgs. 7 and 15 refer to the 
same steps. 

After step 220, the routine proceeds to step 130 wherein it is determined whether the average level Lav is greater 
than a value of a full level minus 1 9dB or not ff a YES answer is obtained, then the routine proceeds to step 40 wherein 
the control circuit 200 provides the control signals & k. and £ of the ON-level to the copyright data generator 100, the 

so spread code generator 1 17, and the switch 201 to start the copyright data embedding operation. Alternatively, if a NO 
answer is obtained in step 1 30, then the routine proceeds to step 30 wherein it is determined whether the peak level Lp 
is greater than the average level Lav or not ff a NO answer is obtained, then the routine proceeds to step 50 wherein 
the control circuit 200 provides the control signals a. fe, and £ of an OFF-level to the copyright data generator 100, the 
spread code generator 1 17, and the switch 201 to prohibit the copyright data embedding operation. 

55 Alternatively, if a YES answer is obtained in step 30, then the routine proceeds to step 240 wherein it is determined 
whether the YES answer in step 30 has been obtained in the first program cycle following a program cycle wherein the 
NO answer was obtained in step 30 or not ff a YES answer is obtained, then the routine proceeds to step 40. If a NO 
answer is obtained, then the routine proceeds to step 50. 
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Rg. 1 9 shows aPI&ram of the copyright data embedding operation according to the sixth embodiment The same 
step numbers as employed in the above embodiments refer to the same steps. 

If a NO answer is obtained in step 240. then the routine proceeds to step 800 wherein an embedding flag F is set 
to one (1). Trie routine proceeds to step 50 wherein the copyright data embedding operation is paused and then returns 
5 back to step 210. 

Alternatively, if a YES answer is obtained in step 240, then the routine proceeds to step 500 wherein it is deter- 
mined whether the embedding flag F is one (1) or not If a YES answer is obtained, then the routine proceeds to step 
470 wherein a timer is actuated to determine whether one (1) millisec has passed or not H a NO answer is obtained, 
then the routine proceeds to step 40 to perform the copyright data embedding operation. 

10 Alternatively, if a YES answer is obtained in step 470, then the routine proceeds to step 490 wherein it is deter- 
mined whether one point five (1 .5) sec. has passed or not. tf a YES answer is obtained, then the routine proceeds to 
step 700 wherein the embedding flag F is set to one (1). Alternatively, if a NO answer is obtained, then the routine pro- 
ceeds to step 600 wherein the embedding flag F is set to zero (0) and proceeds to step 50 to hold the copyright data 
embedding operation from being started. 

is If a NO answer is obtained (F = 0) in step 500. then the routine proceeds directly to step 490. 

Specifically, the copyright data is, as shown in Figs. 20(a) and 20(b), embedded into an output signal from the A/D 
converter 31 for one (1) millisec. following a rise of the signal. The copyright data embeddng operation is performed a 
given number of times at intervals longer than at least 1 .5 sec. until the contents of the copyright data are all recorded. 
In other words, the copyright data is embedded into the output from trie A/D converter 31 in a burst form. This avoids 

20 degradation in quality of analog signals that are reproduced. 

Fig. 21 shows a program of the copyright data embedding operation which is a modification of the sixth embodi- 
ment in Fig. 19. The same step numbers as employed in Rg. 19 refer to the same steps. 

After step 220, the routine proceeds to step 130 wherein it is determined whether the average level Lav is greater 
than a value of a full level minus 1 9dB or not If a YES answer is obtained, then the routine proceeds to step 500. Atter- 

25 natively, if a NO answer is obtained, then the routine proceeds to step 430. This embodiments, likewise to the sixth 
embodiment, embeds the copyright data into an output signal from the A/D converter 31 for one (1) millisec. following 
a rise of the signal a given number of times at intervals longer than at least 1 .5 sec. 

Rg. 22 shows a program of the copyright data embedding operation according to the seventh embodiment which 
is a modification of the sixth embodiment in Rg. 19. The same step numbers as employed in Rg. 19 refer to the same 

30 steps. 

This program is designed to change time intervals or cycles Tx, at random, in which the copyright data embedding 
operations are performed for preventing the copyright data from being recorded at constant time intervals. 

If a YES answer is obtained in step 470 meaning that one (1) millisec. has passed, that is, that the copyright data 
embedding operation is completed, then the routine proceeds to step 491 wherein the cycle Tx is determined at random 
35 within a range from 1 0 millisec. to 1 .5 sec. The routine proceeds to step 492 wherein it is determined whether the cycle 
Tx has passed or not If a YES answer is obtained, then the routine proceeds to step 700 wherein the embedding flag 
F is set to one (1). Alternatively, if a NO answer is obtained, then the routine proceeds to step 600 wherein the embed- 
ding flag F is set to zero (0). 

Rg. 23 shows a program of the copyright data embedding operation which is a modification of the seventh embod- 
40 iment in Rg. 22. The same step numbers as employed in Rg. 22 refer to the same steps. 

After step 220, the routine proceeds to step 1 30 wherein it is determined whether the average level Lav is greater 
than a value of a full level minus 1 9dB or not If a YES answer is obtained, then the routine proceeds to step 500. Alter- 
natively, if a NO answer is obtained, then the routine proceeds to step 430. 

Specifically, the copyright data is, as shown in Rg. 24(b), embedded into an output signal from the A/D converter 
45 31 each time the level of the signal rises. Additionally, the copyright data is also embedded in afferent cycles Tx as long 
as the average level Lav is greater than the value of the full level minus 1 9dB. 

The decoder 500, as shown in Rg. 8. is designed to output a bit stream read out of a record carrier (e.g., a DVD) 
as is through the copyright data updating circuit 30. the switch 51 , and the bit stream output terminal 52. An identif ica- 
tion code is inputted to the decoder/comparator 50 from the terminal 49. The decoder/comparator 50 is responsive to 
so the identification code and the copyright data inputted from the DVD decoding circuit 42 to dose the switch 51 and to 
control the copyright data updating circuit 30. 

Specifically, when the identification code is inputted, the decoder/comparator 50 determines whether it is correct or 
not If the identification code inputted is determined to be correct the decoder/comparator 50 checks copy information 
contained in the copyright data, for example, the number of copy allowable times allowing a copy to be made. If it shows 
55 a value other than zero (0), the decoder/comparator 50 controls the copyright data updating circuit 30 to decrement a 
value contained in the input bit stream indicative of the number of copy allowable times by one (1) and closes the switch 
51 . allowing the bit stream to be outputted from the bit stream terminal 52. Alternatively, if the number of copy allowable 
times shows zero (0), the decoder/comparator 50 opens the switch 51 to block the communication between the copy- 
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right data updating circuit 30 and the bit stream output terminal 52, thereby prohibiting a cop^^ 

A copy allowable term code may also be recorded on a record carrier in addition to the number of copy allowable 
times. In this case, the decoder/comparator 50 prohibits a copy when the copy allowable term expires even H the iden- 
tification code inputted is correct. 

Fig. 25 shows a circuit structure of the signal processing circuit 32 of the copyright information embedding appara- 
tus 300 according to the eighth embodiment of the invention. The same reference numbers as those in Fig. 2 refer to 
the same parts, and explanation thereof in detail will be omitted hera 

The signal processing circuit 32 of this embodiment, as can be seen from the drawing, does not have the switch 
201 . and the control circuit 200 directly controls the level control circuit 1 1 8. The level control circuit 1 1 8 controls the 
level of an output from the spread modulator 1 16 based on the frequency of the data stream of xbt and xa1 outputted 
from the decimating circuit 38 and a control signal from the control circuit 200 and provides it to the adder 121. The 
adder 121 embeds the level-controlled signal from the level control circuit 1 18 into an output signal from the A/D con- 
verter 31 in a manner, as will be described below in detail. 

Fig. 26 demonstrates the so-called audibility masking effect A solid line represents a making curve defined by a 
maximum level of a signal (code) C to be masked by a signal (music) M. A masking sensitivity X (= CM R) depends upon 
the characteristics of the making signal M and is known as follows: 

about 25dB when the signal M likes a tone (close to sine wave) 
about 3dB when the signal M likes noise 

An actual audio signal will further be dose to a tone at lower frequencies, while at higher frequencies, overlap of 
harmonics of different musical instruments will cause noisa Therefore, the masking sensitivity X(-CMR) may be deter- 
mined, as shown in Fig. 26 and 27, according to the frequency of the signal M. 

Based on the above fact, the level control circuit 1 18 decreases the level of a modulated signal fi e., the signal C) 
of the copyright data down to at least a level, as shown by a solid line CO in Fig. 28. which is an inaudible level lower 
than that of an original audio signal (i.e., the signal M) by the CMR (Code to Music Ratio) in the psychoacoustic mode), 
as shown in Fig. 27, based on the frequency of the data stream of xbi and xa1 outputted from the decimating circuit 38. 
The adder 121 then, as described above, embeds the level-controlled signal from the level control circuit 118 into an 
output signal from the A/D converter 31. 

Fig. 29 shows a program of the copyright data embedding operation performed by the control circuit 200 of the cop- 
yright information embedding apparatus according to the ninth embodiment. The same step numbers as employed in 
the above embodiments refer to the same steps, and explanation thereof in detail will be omitted hera 

In step 230, it is determined whether the peak level Lp is smaller than the average level Lav or not If a NO answer 
is obtained, then the routine proceeds to step 560 wherein the level control circuit 1 18 detects the frequency of the orig- 
inal audio signal M (i.e., the frequency of the data stream of xbi and xa1 outputted from the decimating circuit 38) and 
brings the level of a modulated signal outputted from the spread modulator 1 16 along the line CO. as shown in Fig. 28. 
according to the frequency detected. Alternatively, if a YES answer is obtained in step 230. then the routine proceeds 
to step 550 wherein the level control circuit 1 1 8 brings the level of the modulated signal from the spread modulator 1 1 6 
along a broken line C1 higher in level (i.e., the energy density (dB/Hz)) than the line CO. 

Specifically, the modulated signal outputted from the spread modulator 116 is, as can be seen in Figs. 30(a) to 
30(c). increased in level above the line CO for a period of time during which the average level Lav is decreased to agree 
with the peak level Lp after the modulated 6ignal drops in level. 

Fig. 31 shows a program of the copyright data embedding operation which is a modification of the one shown in 
Fig. 29. The same step numbers as employed in the above embodiments refer to the same steps. 

After step 220. the routine proceeds to step 130 wherein it is determined whether the average level Lav is greater 
than a value of a full level minus 19dB or not If a YES answer is obtained, then the routine proceeds to step 560 wherein 
the level control circuit 1 1 8 brings the level of an output from the spread modulator 1 1 6 along the line CO. as shown in 
Fig. 28 or Fig. 34, according to the frequency of the original audio signal M. Alternatively, if a YES answer is obtained 
in step 230. then the routine proceeds to step 550 wherein the level control circuit 1 1 8 brings the level of the output from 
the spread modulator 116 along the broken line C1 in Fig. 28 or Fig. 34. 

Fig. 32 shows a modification of the signal processing circuit 32 of the copyright information embedding apparatus 
300 shown in Fig. 25. 

The signal processing circuit 32, as can be seen from the drawing, does not have the decimating circuit 38 which 
removes the data xi from the input signal. Specifically, the difference calculating circuit 39 determines difference data 
A1 i, A2i. and A3i, as shown below. 



xbi-xci- A1i 



10 



Page: 10 



EP0 822 550A1 

xai - xci = A2i 



xi-xa = A3i 

5 The allocation circuit 40 packs the data stream of xci, A1 i, A2i. and A3i and the copyright data together and outputs 
it The copyright data is, similar to the eighth embodiment embedded into the data stream of xci, A1i, A2i, and A3i inter- 
mittently. 

An decoder decoding a signal coded by the copyright information embedding apparatus including the signal 
processing circuit 32 in Fig. 32 has the same circuit structure as the one shown in Fig. 12. 

io While the present invention has been disclosed in terms of the preferred embodiment in order to facilitate a better 
understanding thereof, it should be appreciated that the invention can be embodied in various ways without departing 
from the principle of the invention. Therefore, the invention should be understood to include all possible embodiments 
and modification to the shown embodiments which can be embodied without departing from the principle of the inven- 
tion as set forth in the appended claims. 

15 A copyright information embedding system is provided which is designed to embed information for copyright pro- 
tection into digital audio signals without deterioration of analog audio signals reproduced. The copyright information 
embedding system includes an A/D converter, a modulator, a level detector, and a copyright data embedding circuit 
The A/D converter converts an analog audio signal into a digital signal. The modulator modulates a copyright data sig- 
nal for the digital signal using spectrum spread. The level detector detects a variation in level of the digital signal. The 

20 copyright data embedding circuit divides the copyright data signal into several codes and embeds them into the digital 
signal each time the variation in level of the digital signal shows a preselected variation such as a rapid rise or drop. 

Claims 

25 1. A copyright information embedding apparatus comprising: 

A/D conversion means for converting an analog audio signal into a digital signal; 
modulation means for modulating a copyright data signal for said digital signal using spectrum spread; 
level detection means for detecting a variation in level of said digital signal; and 
so a copyright data embedding circuit embedding the copyright data signal into the digital signal when the varia- 

tion in level of said digital signal detected by said level detection means shows a preselected variation. 

2. A copyright information embedding apparatus as set forth in claim 1 , wherein said copyright data embedding circuit 
embeds the copyright data into the digital signal during a time when a level of the digital signal is decreased. 

35 

3. A copyright information embedding apparatus as set forth in claim 1 . wherein said copyright data embedding circuit 
embeds the copyright data into the digital signal during a time when a level of the digital signal is increased. 

4. A copyright information embedding apparatus as set forth in claim 1 , wherein said copyright data embedding circuit 
40 records the copyright data into the digital signal intermittently. 

5. A copyright information embedding apparatus as set forth in daim 1 , wherein said copyright data embedding circuit 
records the copyright data into the digital signal in random cycles. 

45 6. A copyright information embedding apparatus as set forth in claim 1 , wherein said copyright data embedding circuit 
also embeds the copyright data into the cfigital signal when a level of the digital signal sampled over a preselected 
period of time is greater than a given value. 

A record carrier comprising: 

a digital signal into which an analog audio signal is converted; and 

a copyright data signal carrying copyright information about said digital signal, modulated with spectrum 
spread, said copyright data signal being embedded into said digital signal each time a variation in level of said 
digital signal shows a preselected variation. 

A record carrier as set forth in claim 7, wherein the copyright data signal is embedded into the digital signal during 
a time when a level of the digital signal is decreased. 
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9. A record carrier as set forth in claim 7, wherein the copyright data signal is embedded intffie digital signal during 
a time when a level of the digital signal is increased. 

10. A record carrier as set forth in claim 7. wherein the copyright data signal is embedded into the digital signal inter- 
5 mrtterrtJy. 

11. A record carrier as set forth in claim 7, wherein the copyright data signal is embedded into the digital 6ignal in ran- 
dom cycles. 

io 12. A record carrier as set forth in claim 7, wherein the copyright data signal is also embedded into the digital signal 
when a level of the digital signal sampled over a preselected period of time is greater than a given value. 

13. A record carrier as set forth in claim 7, further comprising a second copyright data signal identical with said copy- 
right data signal which is recorded on a subcode of said digital signal. 

14. A record carrier as set forth in claim 7, further comprising a second copyright data signal identical with said copy- 
right data signal which is recorded on a copyright information management area defined on the record carrier. 

15. A copyright information embedding apparatus comprising: 

20 

A/D conversion means for converting an analog audio signal into a digital signal; 

modulation means for modulating a copyright data signal carrying copyright information about said digital sig- 
nal using spectrum spread; 

frequency detection means for detecting a frequency of said digital signal; and 
25 a copyright data embedding circuit embedding the copyright data signal into the digital signal at a preselected 

power level different from that of said digital signal. 

16. A copyright information embedding apparatus as set forth in claim 15, wherein said copyright data embedding cir- 
cuit detects a variation in level of said digital signal and changes the power level according to the variation in level 

so detected. 




17. A copyright information embedding apparatus as set forth in claim 16, wherein said copyright data embedding cir- 
cuit embeds the copyright data signal into the digital signal at the preselected power level regardless of the varia- 
tion in level of said digital signal when a level of the digital signal sampled over a preselected period of time is 
ss greater than a gjven value. 



18. A record carrier comprising: 

a digital signal into which an analog audio signal is converted; and 
40 a copyright data signal carrying copyright information about said digital signal, modulated with spectrum 

spread, said copyright data signal being embedded into said digital signal at a preselected power level different 
from that of said digital signal. 

19. A record carrier as set forth in claim 18. wherein the preselected power level is changed according to a variation in 
45 level of said digital signal. 

20. A record carrier as set forth in claim 19, wherein the copyright data signal is embedded into the digital signal at the 
preselected power level regardless of the variation in level of said digital signal when a level of the digital signal 
sampled over a preselected period of time is greater than a given value. 

so 

21. A record carrier as set forth in claim 18, further comprising a second copyright data signal identical with said cop- 
yright data signal, recorded on a subcode of said digital signal. 



22. A record carrier as set forth in claim 18. further comprising a second copyright data signal identical with said cop- 
55 yright data signal, recorded on a copyright information management area defined on the record carrier. 

23. A copyright information embedding method comprising the steps of: 
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A/D-conver^^ an analog audio signal into a digital signal; 

modulating a copyright data signal for said digital signal using spectrum spread; 

detecting a variation in level of said digital signal; and 

embedding the copyright data signal into the digital signal when the variation in level of said digital signal 
detected by said level detection means shows a preselected variation. 

24. A copyright information embedding method comprising the steps of: 

A/D -converting an analog audio signal into a digital signal; 

modulating a copyright data signal carrying copyright information about said digital signal using spectrum 
spread; 

detecting a frequency of said digital signal; and 

embedding the copyright data signal into the cfigital signal at a preselected power level different from that of 
said digital signal. 

25. A copyright information embedding apparatus comprising: 

A/D conversion means for converting an analog audio signal into a digital signal; 

modulation means for modulating a copyright data signal for said digital signal using spectrum spread; 

level detection means for detecting a level of said digital signal; and 

a copyright data embedding circuit embedding the copyright data signal into the digital signal when the level of 
said digital signal detected by said level detection means lies within a preselected ranga 
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